Papers by Anthony Man-Cho So
Probe-Free Low-Rank Activation Intervention (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing activation intervention methods involve an activation probe to detect undesirable generation, triggering the activation modification to steer subsequent generation. |
| Approach: | They propose a probe-free intervention method FLORAIN for all attention heads in a specific activation layer. |
| Outcome: | The proposed method outperforms baseline methods in enhancing model truthfulness and quality across generation and multiple-choice tasks. |